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(57) A video edrting system has the functions of: a) 
scene browsing with next and back icons and/or a scroll 
bar; b) recursive scene segmentation available with the 
browsing function; c) scene/cflp spe cifi c ati on with a 
reversing option (in case of a system with two display 
areas ); d) recursive scene grouping; d) scene dipping 

FIG. 3 
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based on selection by default; e) dip sorting in order of 
time or in a specified order; f) relative position restora- 
tion of a specified scene (in case of a system with a sin- 
gle display area); g) clamping a scene to its original play 
time; and h) scene transition processing. 
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Description 

BACKGROUND OF THE INVENTION 
5 1. Field of the Invention 

[0001 ] The invention generally relates to a digital video editing method and system and. more particularly, to a method 
and system tor assembling an edited program from one or more digital video source material taken in from a video cam- 
era, storage media and/or transmission medfe by selecting and ordering segments (or scenes) of the video source 
10 materials. 

2. Description of the Prior Art 

[0002] US. Patent 5,537.530 issued July 16, 1996 discloses a typical method for editing video comprised of a 
75 sequence of video segments by locating segment boundaries and reordering segment sequences. Frames associated 
with sequences of video source material representing a series of scene changes are cfigitized. The cfigitized information 
is analyzed to identify one or more frames of the soiree material associated with and representative of each such scene 
change and/or sequence. The representative frames are cfsplayed. A selected frame from the display wtD thereby 
cause automatic selection and association of a sequence of frames. The corresponding frames of video segments or 
20 scenes corresponcfing to each such selected and ordered representative frarre are 

Simplified video ecfiting is accomplished by manipulating these representative frames, each associated with a efferent 
scene or video sequence. 

[0003] U.S. Patent 5.237.648 issued Aug. 17, 1993 cfiscfoses "Apparatus and method for editing a video recording by 
selecting and displaying video clips." In the editing system, the user is presented with a video window for displaying the 
25 video information, a control window for regulating playback of the video in fo rm ati on, and a dp list window having a 
number of rows of edit windows organized under begin, end. and cfip columns. The user can generate video clips and 
change the clips by clicking on the desired video frame to generate a small cSgitized version of the frame and moving 
thesmaQ digitized frame from the video window to an ecfit window. 

[0004] US. Patent 5,218,672 issued June 8. 1993 discloses a post production off-line editing system tor storing 
30 unedited video takes in a random access memory (a set of laser video disk players), displaying selected takes (or incfi- 
vidual frames from selected takes) and generating an edit list which defines an edited video program. The user can 
include, in the edit list definitions of various video transitions between scenes, such as dissolves, fades, and wipes. 
[0005] However, prior art video editing systems provide only an editing method based on either selection or elimina- 
tion of a specified video scene. In some cases, it wfl) be desirable to specify and select a necessary portion, and in other 
35 cases, it may be desirable to specify and eirrinate an unnecessary portion. It is therefore an object of the invention to 
provide a video editing system which permit the user to issue a desired one of selection and deletion comm an ds for a 
specified object 

[0006] The above and other prior art video ecfiting sv^ undo function, Issuing some undo 

commands art a certain editing state causes to editing state to be restored to the previous editing state by each 

ao of the issued undo comnriands. However, it may be sometimes desired to restorer posi- 
tion in order with respective to the scene which was just before or after the specific scene in order before the specific 
scene has taken the current position. Therefore, it is another object of the invention to provide a video editing system 
raving a restore function of restoring a specified scene to its last relative position in order with respective to the scene 
which was just before or after the specific scene in order before the specific scene has taken the current position. 

45 [0007] In the above and other prior art video editing systems, a series of frames or a scene is dealt with as an edting 
unit (or a cfip). However, there are sometimes two or more scenes that the user desires to manipulate as a single clip 
though the scenes are cfscontinuous in time or derived from (Afferent source videos. 

invention to provide a video editing system which not only permits the user to group two or more scenes together to 
make the grouped scenes a dip but also provides various improved and novel functions such as enhance the user's 
so convenience and the efficiency of video editing. 

SUMMARY OF THE INVENTION 

[0008] Accorcfing to the invention, a video editing system comprises a computer system provided with a mass storage 
55 and further provided or connected with oro a rrore video source such as an optical 

(VCR) and/or camera The computer system operates under the control of standard operating software and video edit- 
ing software stored in the mass storage. 

[0009] In preparation for a subsequent editing process, one or more source videos are first col) ected and stored as 
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video soiree material in the mass storaga One or more of the stored source videos is (or are each) checked to gener- 
ate scene records which define respective video segments constitut in g the source vkfeo($). Scene records are also 
generated for the other source videc^ Thereafter, the vide^ other source videos are called "scenes* 

and dealt with by operating respective scene records. 
5 [0010] The display screen of the system has at least one scene cfcplay area. The area is exxnprised of an array of 
windows for each displaying a frame representative of each of available scenes constituting the source videos (the 
frame is hereinafter referred to as "a scene index"). The scenes are displayed in the area even if they are selected as 
dips for use in the video program. 

[0011] In a preferred embedment the records are maintained as a scene table Each record has at least the field of 
io an ID and the length-in-runnber. Each record preferably contains begin and end frame numbers, a selection flag, a 
frame pointer for scene scrolling, a compone n t scene IDs for grouping capability, a selected order for clip sorting in 
selected order, a clamp flag for scene damping, and a transitional effect 

[001 2] Simulation is conducted through manipulations of scene and clip indexes, e.g. , segmentation, grouping, dip- 
ping, ordering, etc. Information on a series of such man^putatfons is accumulated in the scene table. Finally, a dp fist is 
is obtained. According to the cfip fist an ecfited video program is compiled. 

[001 3] According to the principles of the invention, one or more frame of a user-specified scene or dp is cSsplayed. 
Any frame of the scene is accessWe by controffing forward and backward button and a scrolling bar. The value of a 
frame pointer is stored for each index, enabling a resume of viewing. 

[0014] Specifying desired scenes or dips* the user can group the desired scenes or cfips. In grouping, a scene record 
20 is added to the scene table. IDs of grouped scenes or dips are stored in a component field of the added record. An 
index for the group is added to an index set The indexes for the specified indexes are deleted from the index set The 
grouping is achieved either in order of time if the specified scenes or dps have been derived a single source video or 
in a specified order. Grouped scenes or dips are further grouped. 

[001 5] In an errixxfiment with two display areas for scenes and clips, once scenes are grouped, the grouped scene 
25 becomes a clip automatically. That is, the grouped scenes disappear from the scene display area, instead appear in a 
dip display area 

[0016] Also, in an errtxxlirnent with scene and cfip display areas, a flexible index specifying fiinction is provided If the 
user specifies desired ones of the indexes, the desired ones are become in a specified state and the remaining indexes 
become in a nonspecified state If the user enters a predetermined input at this point of time, the specified state and the 
30 nonspecified state are reversed. 

[0017] Selection and unselecticnfunctxTO respectively. 
This functions can be applied to the same scero or dp at any times Each time one 

fields (selected order fields in an fflustrative ernbodiment) of the record are so updated that the selected order fields 
retain values indicative of the order of selection of respective scenes and cfips. By doing this, the dips can be sorted in 
35 the selected order. 

[0018] The cfips can be sorted in order of time rf the clips are derived from a single source video. 

[0019] Each time a segmentation or a grouping is performed, predetermined fields (original order fields in an Qlustra- 

tive embocSment) of the records which each contain the order of the scenes 

reflect the order of current scene indexes. If the user issues a predetermined cornmand while specifying a desired 
40 scene index, then the specified scene index is restored to a relative position with respect to a scene index which the 
specified scene index was adjoining at a time of occurrence of a predetermined event In a preferred embodiment the 
event is a later one of a last segmenting and a last grouping. The user can select whether the specified scene index 
should be restored to a next-based relative position or a back-based relative position. 

[0020] The video editing system is further provided with a function for causing a start time, in the edited video, of a 
45 user-specified one of the video segments (derived from a single source video) to be the same as that in the single 
source video (hereinafter referred to as "damping the user-specified video segment to the single source video"). For 
this purpose, the user can issue a comrnand to clamp aspect 

of a record associated with the specified video. Then, in a compiling process, a scene just preceding the specified video 
is so trimmed that an end frame number of the preceding scene in a program being compiled is smaller by one than a 
so value of a begin frame field of the record associated with the specified video. 

[0021 ] Also, the user can set one of predetermined transitional video effects to an effect-containing field of a record 
associated with a user-specified index. Then, an effect idenffied by the effect-containing field is applied to the video 
segment associated with the user-specified index. 

55 BRIEF DESCRIPTION OF THE DRAWING 

[0022] Further objects and advantages of the present invention will be apparent from the following description of the 
preferred errtxxfimerrts of the invention as illustrated in the accompanying drawing, in which: 
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RG. 1 rs a schematic block diagram showing an arrangement of a video ecfiting system embodying the princples 
of the invention; 

FIG. 2 is a cfiag/am Blustrating contents of the mass storage device 112 of FIG. 1; 

FIG. 3 is a schematic clagram aiustrating exemplary operations of the user and the controller 1 1 0 (or a not-shown 
s CPU) of the video editing system 100 under the control of the video editing program 20 in accordance with a first 
illustrative embodiment of the invention; 
FIG. 4 shows an example of the ec5t display screen; 

FIG. 5 is a cfiagjam showing how various data are stored in the mass storage 112; 
FIG. 6 is a cfiagjam showing an example of a scene table just after the creation thereof; 
10 FIG. 7isac5agramshowinganexan^eof thescero ag., CA has been segmented; 

FIG. 8 is a diagram showing an exemplary arrangement of the scene indexes displayed in the scene display area 
43 after the automatic logical segmentation of the scene CA; 

RG. 9 is a diagram showing the structure of a part of the scene table 520 which part follows the ORG ORDER field 
522; 

is FIGs. 10A and 10B, when combined, constitute a ftowchart stewing an exenp 
mentation subroutine 200 accord ng to the principles of the invention; 

FIG. 11 is a diagram showing two exemplary ways of frame display in the scene browsing function; 

FIG. 12 is a flowchart showing an exemplary operation of a grouping subroutine 230 according to the principles of 

the invention; 

20 FIG. 13 is a diagram illustrating how scenes are grouped in accordanc e with the principles of the invention; 

FIG. 14 is a dag/am illustrating an example of grouping of grouped scenes in accordance with the principles of the 
invention; 

FIGs. 15 and 16 are flowcharts showing exemplary operations of an unselection si&routine 300 and a selection 
subroutine 310 according to the principles of the invention; 
25 FIG. 17 is a flowchart showing an exemplary operation of a sort subroutine 260 accorcfing to the principles of the 
invention; 

FIG. 18 is a flowchart showing an exemplary operation of a relative position restoration subroutine 250 according 
to the principles of the invention; 

FIG. 19 is a diagram illustrating how the relative position restoration function works in accordance with the inven- 
30 tton; 

FIG. 20 is a cSag/am showing an example of a video program assembling process attended with the damping of a 
dip in accordance with the principles of the invention; 

FIG. 21 is a flowchart showing an exemplary operation of a clamp setting subroutine according to the prindples of 
the invention; 

36 RG. 22 is a flowchart showing an exemplary operation of a transitional effect setting subroutine according to the 
principles of the invention; 

RG. 23 is a flowchart showing an exemplary operation of a video program compiler subroutine accord ng to the 
principles of the invention; 

RG. 24 is a diagram illustrating how the specitieoYunspectfied states of the scenes or dips are reversed; 
40 FIGs. 25 and 26 are flowcharts showing exemplary operators of a setecfoisub^ 
routine 330 according to the principles of the invention; 

RG. 27 is a diagram showing an example of a scene selection in which a selection command is executed after 
reversing the spedfieoTunspecified state of the scenes; and 
FIG. 28 is a diag/am showing an example of an 
46 tkm 

[0023] Throughout the drawing, the sajne elements when shown in more than one figure are designated by the same 
reference numerals. 

50 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0024] FIG. 1 is a schematic block cfiagram showing an arrangement of a digital video etfting system 1 00 embodying 
the principles of the invention. In FIG. 1, the video edrting system 1fJ0 is a computer-based system wNch comprises a 
controller 100 induding a central processing unit (not shown), a read only memory (not shown) and a random access 
55 memory (not shown) which are interconnected trtrough a system bus 1 1 1 ; a mass storage device 1 1 2; a keyboard 1 1 6 
and a mouse 118 connected through input interfaces frfe) 114, and a display 122 connected through a video interface 
120. The system 100 may further comprise a loudspeaker 124, in which case the element 120 will comprise a video 
and audio interfaces. The video ecfiting system 100 includes one or more video source device such as a video camera 
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1 automatic; an optica) cfisc player 134, a video cassette recorder (VCR) 136, etc. which is (^ 

tern bus 111 through respective video source interlaces 130. The system 100 further includes a video (and audio) 

decoder 1 38 lor converting a coded video and aucfo data stream into a digital video stream 

which is (or are) supplied to the video (and audio) output interfaced) 120. 

5 [0025] The video(/audio) decoder 138 may be any suitable one such as a standard MPEG decoder. The video (and 
audio) output Ks 120 preferably includes a video (and audk>) digital/analog converter (not shown) and an NTSC 
(National Television Standard Committee) or PAL (Phase Alternation by Line) encoder (not shown) for exarrpia 
[0026] FIG. 2 is a diagram illustrating contents of the mass storage device 112. The mass storage device 1 12 at least 
stores an operating system 10, a video edffng program 20, video source material 1 (comprised of source videos) to be 

w edited, an edited video program 3 ecfited by the video editing program 20, and various data 5 which are created and 
used by the video editing program 20 in the course of an edrtmg process. The operating system 10 nr^ be any surtax 
standard or tailored operating system. 

Embodiment I 

75 

[0027] FIG. 3 is a schematic cfiagram iflustratrig exemplary operations of the user and the controller 110 or the CPU 
(not shown) of the video editing system 100 under the control of the video^ecfiting program 20 in accordance with a first 
illustrative embodiment of the invention. In FIGL 3, bold-line boxes denote operations by the user, fine-One boxes denote 
data, and double-l ine boxes denote displayed contents. 

20 [0028] The user first starts the video-edrting program 20 in step 30. Then, the CPU (or the controller 1 00) cf splays an 
edit display screen 40. FIG. 4 shows an exarrple of the ecfit cfisplay screen 40. tn FIG. 4, the ecfit screen 40 includes 
camera and ffle buttons 41 and 42 for taking in a source video from a camera 132 and files stored in a storage mecfia 
(134 or 136), respectively: The ecfit screen 40 further includes a scene display area 43 comprising an array of small 
frame windows in each of which a frame is displayed, and scroll-up and scroll-down buttons 44 and 45 for scrolling the 

25 cBsplayed frame fines up and down, respectively. 

[0029] The user first takes in at least one source videos 1 by using the camera 41 and file 42 buttons in step 31. The 
CPU responsivety takes in the source videos 1 in a predetermined c&ectoryorfolderof the mass storage 112 as shown 
in FIG. 5 in step 21. Then, the CPU creates a scene table 520 (shown in FIG. 6) and enters records of the takervin 
source videos 1 in the scene table 520 m step 22. Further, the CPU stores a file containing each of the first frames of 

30 the source videos 1 in a predetermined cfirectory in the mass storage 1 1 2 and cfisplays the first frames in the scene cfis- 
playarea 43. It is noted that the source videos 1 may comprise, for example, one content video and a plurality of com- 
mercial videos, or may comprises, for example; a plurality of content videos and a plurality of commercial videos. 
[0030] FIG. 5 is a diagram showing how various data are stored in the mass storage 112, wherein directories are 
shown by underlining respective directory names. A directory is created in the name of a desired video program, say, 

35 "Proc/amX" (in this example) in the mass storage 1 12. The data directory "ProgramX" comprises the directories "Vid- 
eos," "SceneData" and "Scenetndexes" for example. The cfirectory Videos contains the source videos (CA, CB, CC, CD 
in this example) 1 and is to contain an edited video program (ProgramX in this example) 3 when the editing process has 
completed. The cfirectory SceneData contains the scene table as detailed below. The directory Scenelndexes contains 
scene indexes (detailed bek**) corresponcfing to the source videos 1, e.g., CA, CB, CC, CD. The scene indexes are 

40 preferably named identical to corresponding source videos in this example^ 

[0031] FIG. 6 is a diagram showing an example of a scene table just after the creation thereof. The scene table 520 
maintains scene records of afl the pieces of video data or the scenes available for assembling an edited video program: 
i.e.. the takervin source videos (CA, CB, CC, CD in this example) 1 and the video segments obtained from segmenta- 
tion of any source videos as detaDed later. A scene record of each scene includes: ag. begin frame and end frame 

45 fields which, if the scene is a segment of any source video, contain the begin frame number and the end frame number 
of the segment in the original source video; a length-in-frame field which contains the number of frames constitu&ig the 
scene; a length-in-time field which contains the play time, at the normal play speed, of the scene in the form of "M.S" 
where M and S denotes minutes and seconds of the time, respectively; a select field which contains a flag indcativeof 
whether the scene has been selected for assembling a edited video program, e.g., "Y" (for "yes") or "N" (for "no"); and 

so an original order (ORG ORDER) field 522 which contains the display order of the scene index displayed just after an 
automatic segmentation which order is used in a relative positive position restoration function detailed later. 
[0032] Since FK3L 6 shows a scene table 520 just after the creation thereof and accordingly any of the source videos 
has not experienced a segmentation or an ordering, the scene records have no value in the begin and end frame fields, 
and the original order field 522. Specifically, the source video CA has values CA, 132300. 73.30" and Yin the frame ID, 

55 length (frames), and length (time) frames, respectively; the source video CB has values CB, 2700, 1 .30* and Yin the 
respective frames; and so on. The values of the select fields are all Y*s because in default of selection, the illustrative 
embodiment deals wrth the scenes as selected tor use in the object video program. 

[0033] Referring to FIG. 3, if there are any of the source videos 1 that need segmentation, the user applies an auto- 
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matic logical segmentation to such source videos in step 32. Specfficalty, the user species a desired source video with 
a pointy device such as the mouse 1 18 and dte 

a button 47 lor logical segme n t ati on by a certain time interval or frame number, which may be preset by the user, tn 
response to a clicking on the button 46 or 47, the CPU logically segments the specified source video in a respective 
5 manner. That is, the CPU adds a scene record to the scene table 520 for each of the obtained video segments or 
obtained scenes identified by scene changes such as changes in the bii gh tness and/or the color tone or by a time or 
frame interval through the scanning of the specified source video record in step 23. Then, the CPU deletes the scene 
record of the segmented source video from the scene table 520. 

[0034] FIG. 7 shows an example of the scene table 520 after the automatic logical segmentation of a source video, 
10 e.g., CA. As seen from the table of FIG. 7, the scene record CA has been deleted, but six new records are instead 
added in the names CA.1 through CA.& fen this way, the scenes obtained from a segmentation of a source video are 
each named by sffrpry appertiir^ V in this exanple) and a serial rujr^ ID of the source 

video. Since the scenes CA.1 through CA.6 have been derived from a single scene CA, the scene records CA.1 through 
GA.6 have also respective values in the begin and end frame fields, ft is noted that the begin and end frame fields for 
is the raw videos CB, CC and CD are also filled for the sake of convenience. 

[0035] On updating the scene table 520, the CPU deletes the scene index fOe CA from the Scenelndexes cSrectory, 
and adds six scene index files which contain, for example, the first frames of the new scenes CA.1 through CA.6 to the 
scene table 520. Then, the CPU cfispteys, in the scene dsptay area 43, the frames or scene indexes (43-2 of FIG. 3) 
contained in the scene index files (CA.1 through CA.6, CB, CC and CD) in the Scenelndexes directory. In this case, the 
20 scene indexes are preferably dsptayed in order of the segmented scenes and the raw scenes as shown in FIG. 8. For 
this reason, the original order fields 522 of the scene records CA.1 through CA.6. CB, CC and CD contain the values 1 
through 9, respectively. 

[0036] It should be noted that if the scenes and respective scene indexes are stored in the same names in different 
cfirectories as descrbed above, the scene indexes can be managed in the above descrtoed manner. Otherwise, each 
25 record in the scene table 520 will need an additional field for contairring the name of scene index file tor the correspond- 
ing scene. It is also noted that the user is permitted to select any frame in a scene for the scene index, in which case 
the selected frame is stored in the scene index fOe. 

[0037] Referring to FIG. 3, the user selects desired scenes out of the available scenes by specifying desired ones of 
the scene indexes 43-2 displayed in the scene cfisptay area 43, where the selected scenes are thereafter referred to as 
30 "clips,* and arranges the order of the selected scenes or clips in step 34. Responsivety, the CPU fits the select and 
order 522 fields of the scene records in the scene table 520 as detailed later in step 24 and displays the representative 
frames or indexes of the clips and the other scenes such that the dp indexes and the scene indexes are in normal and 
rec&jced contrast, respectively, and the clip indexes are sorted in the arranged order. 

[0038] If the user finally issues an ecfited video program creating command in step 36, then the CPU assembles an 
35 edited video program based on the records of the cfips in the scene table 520 in step 26. 

[0039] The video etfting system 100 accorcfing to the first Blustrative embedment of the invention is provided with the 
capabilities oft 

a) scene browsing with next and back icons anoVbr a scroll bar; 
40 b) recursive scene se g men ta tion available with the browsing function; 

c) recursive scene grouping; 

d) scene dipping based on selection by default/, 

e) cfip sorting; 

t) relative position restoration of a specified scene; 
45 g) damping a scene to its original play time; and 
h) scene transition processing. 

[0040] These features of the video editing system 100 wOl be deserted referring to FIG. 9. 

so Browsing and Se gm ent a tio n 

[0041] A frame pointer fieW 524 d the scene table 

tiontrtatiixScmesatrametobe Vvlien a new scene record is created, the valued 

is set equal to the value of the begin frame field of the same record if the begin frame field has a value and is set to 1 
ss otherwise. 

[0042] FIGs. 10AarxJ 1QB, whencc^Ttaned, constitute a ftowcliart showing operation of a browsing and 

segmentation subroutine 200 according to the principles of the invention, ft the user performs a predetermined opera- 
tion such as a clicking on a scene browser icon, a selection of an item "Browse Scene" from the menu, etc, whfle spec- 
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"rfying a desired one of the scene indexes cfisptayed in the scene tispfay area 43, then the main routine of the video 
editing program 20 calls the browsing and segme ntat ion subroutine 200. Then, the CPU begins executing the subrou- 
tine 200 with step 202, where the CPU calculates and sets the initiaJ value of a scrolfing switch 48 of a scroB bar 49 from 
the values of the begin and end frame fields and the frame printer field 524 of the specified scene record in step 202. 

5 The calculation in this case is a we»-known rule-oMhree sura It is assumed that there is a not-shown scroi bar 94 rou- 
tine which outputs a relative position information on the scrolfing switch 48 in response to an operation of the user with 
a capability of setting the initial position of the switch 48 accorting to an argument passed in a suitable form. 
[0043] In step 204, the CPU cfisptays one or more frame incfcxfing the frame pointed by the frame pointer, i.a, the 
value of the frame pointer field 524 of the scene record of the specified scene in a predetermined manner. FIG. 11 isa 

ro diagram showing two exemplary ways of frame cfisptay in the scene browsing function. As shown in F!GL 11, a plurality 
of frames including the frame identified by the frame pointer 524 may be cfsptayed in a display area or view window 61 
created ever the specified scene index GO (a multiple frame cfisplay), or the single frame identified by the frame pointer 
524 may be displayed in a view window 61. A next and back icons 63 and 64 are preferably cfisptayed near the view 
window 61 , ag. t below it 

is [0044] If the user clicks on either the next 64 or back 63 icon in step 206, then the CPU irroements the value obtained 
from the pointer field 524 in case of the next icon 64 and decrements the value otherwise in step 208. The CPU makes 
a test, in step 209, to see if the value or the frame number is in the range from the begin frame number to the end frame 
number of the scene in question. If sex then the CPU stores the value in the pointer field 524 in step 210 and goes back 
to step 204 to display an adjoining frame Otherwise, the CPU returns to decision step 206. If either the next or back 

20 icon has not been operated in step 206, the CPU proceeds to decision step 21 1 , where the CPU makes a test to see if 
the user operates the scrolling switch 48. If so, then in step 21 2 the CPU calculates the value of frame printer 524 from 
the relative position data of the scroffing switch 48 on the scrofl bar 49 and the values of the beg'n and end frame fields 
of the scene table 520 and proceeds to the above described step 2 1 0 to cfisplay frame(s) n ear a desi red position. 
[0045] If the test result is NO in step 211, then the CPU makes another test in step 214 to see if the user issues a 

25 segmentation exxnrnand. If so, the CPU proceeds to step 222 of FIG. 1 0B to perform a segmentation as described later. 
Otherwise, the CPU makes a test in step 218 to see if the user desires to terminate the browsing mode. If not, then the 
CPU returns to step 206. ff the test result is Yes in step 21 8, then the CPU returns to the main routine of the video ecfit- 
ing program 20 after ascertaining in step 219 that a predetermined queue (used in segmentation as described below) 
is empty. 

30 [0046] The user is preferably permitted to control the size of the view window 61 . 

[0047] It is noted that the value of the frame pointer field 524 is retained after the terminatjon of a browsing mode for 
a scena This ensures the resumption of the browsing mode for the scene. 

[0048] The user is permitted to segment a scene at a desired frame thereof while browsing the scene as described 
in connection with steps 214. ff the user issues a segmentation command in a predetermined manner in step 214, the 

35 CPU proceeds to step 222 of FIG. 10B. In step 222, the CPU dsptays a dialog box to ask the user whether the current 
frame should be made the end frame of the former segment or the begin frame of the latter segment and prompt the 
user to select either of the former and the latter, ff the user select one of the two (he or she may change his or her rrind 
and desire to quit the se g men tati on), then, in step 224, the CPU adds the current frame number as ft is to a predeter- 
mined (end frame) queue rf the user selects the former (i.e., desires to make the current frame the end frame of the 

40 former segment), and adds the current frame number minus one to the predetermined queue if the user selects the lat- 
ter. In step 226. the CPU asks the user whether he or she desires to segment the scene further. If so, the CPU returns 
to step 206 of FIG 1 0A to continue the browsing for further segmentation; thereafter operates as descrfoed above; and 
returns to step 222 from step 214 of FIG. 10A or proceeds to step 227 from step 219 of FIG 10A. If the answer is NO 
in step 226 or if the queue is not empty in step 219, then the CPU proceeds to step 227, where the CPU closes the 

45 cfialog box and performs logical segmentation of the scene according to the contents of the predetermined queue 
[0049] Specifically, the CPU adds to the scene table 520 scene records having the frame numbers contained in the 
o^eue as respective errifrairenu^ scene index fie of the seg- 

mented scene from the scene table 520 and the Scenelndexes directory, respectively; and adds sc&ie index f^es of the 
new scenes to the Scenelndexes directory. Again, the new scenes obtained from the segmentation of the scene are 

so each named by simply appending a defimiter (ag., V in this example) and an additional ID part (e g., a serial number 
in this case) to the scene ID of the scena The delimiter may be any suitable symbol. The additional ID part may be any 
suitable expression inckxfing a sequential notation such as a serial number, an alphabet, etc. For example, if the scene 
CA.2 is segmented into three, then the new scenes are CA.2.1 through CA^.3. In this way. the invention ensures recur- 
sive segmentations and facilitates undo operation. 

55 [0050] After step 227, the CPU dears the queue in step 228. Finally, the CPU updates the ORG ORDER fields 522 
of the scene table 520 for the sake of a relative position restoration function (detailed below) in step 229, and returns to 
the main routine of the video-editing program 20. 
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Grouping Scenes 

[0061] It is assumed that the video editing system 100 is provided with a flexible scene specifying function which can 
specifying a plurality of scenes inducing successive ones and separated ones to pass them to other function. The user 

5 is pei milled to group the scenes specified by a specifying operation into a single scene by issuing a grouping command. 
[0052] In grouping the specified scenes, the scenes can be ordered in some ways. Since the scenes are generally 
classified into two types — an order-sensitive type and an independent type, scene types have to be considered in 
grouping. A group of scenes of the order-sensitive type are scenes obtained by a segmentation of a scene, i.e. scenes 
the names of which each include at least one delimiter in the scene-naming scheme. Scenes of the independent type 

10 are raw videos or scenes which have experienced no segmentation (and accordingly have no delimiter in respective 
names). 

[0053] Also, the user is permitted to specify one of orde rin g schemes — a time sequence and a specified sequence 
except when the specified scenes are of the independent type If the specified scenes are of the independent type, the 
only ordering scheme the user can specify is the spectfted sequence. 
15 [0054] It is noted that the above-mentioned scene specifymg function reports rrt 
the specified orders of the IDs. 
[0055] FIG. 12 is a ftowchart showing an exemplary c^ 

of the invention. If the user issues a grouping command with desired scenes specified, the CPU enters the grouping 
subroutine 230. In step 232, the CPU makes s a test to see if the user specified any orderi ng schema ff not the CPU 

20 keeps the relative positions of the specked scene indexes in the scene display area 43 in step 234 (Case 1 ) . If the user 
has specified any ordering scheme in step 232 and if the scheme is the specified sequence scheme in step 236, the 
CPU sorts the scenes ffi the specified order while keeping the order of scenes specified by a drag of the mouse 118 as 
they are in step 238 (Case 2). If the scheme is not the speeded sequence (but the time sequence scheme) in step 236, 
then the CPU makes a test in step 240 to see rfaOof the specified scenes are of me order-sensitive type. If so, the CPU 

25 sorts the scenes in order of time in step 242 (Case 3). Otherwise, the CPU sorts only the order-sensitive scenes in order 
of time while keeping the order of the rest in step 244 (Case 4), 

[0056] After any of steps 234, 238, 242 and 244, the CPU proceeds to step 246, where a scene record of the scene 
into which the speeded scenes are grouped is added to the scene table 520. In this case, a COMPONENTS field 526 
of the scene table 520 contains scene IDs of the specified scenes in an order determined in the above-described man- 
so ner. In step 247, the CPU updates the ORG ORDER fields 522 of the scene table 520 as detailed later. Then, instep 
248, the CPU deletes, from the directory Scenetndexes, the scene indexes of the specified scenes except the scene 
index of the scene which appears first in the new scene, and displays the scene indexes in the directory Scenetndexes. 
[0057] It is noted that the begin and end frame fields of a grouped scene have no values because these values can 
not be determined (except for a special case as detailed later) til a clip list which defines an edited video program is 
35 completed. 

[0058] FIG. 13 is a cfiagram fflustrating how scenes are grouped in accordance with the princfcles of the invention. In 
FIG. 13, CURRENT STATE shows the "current state* of the scenes. In the rows labeled SPE. 1 and SPE. 2, isolated 
mimerals each indk^ the order of specf^ 

extending across a pturafity of scene indexes indicates that the scene indexes along the cvertine are specified in the 

40 order specified by the numeral. 

[0059] Specifically, the row SPE. 1 indicates that CC is first specified and then CA.2, C/U and CA.3 are speeffied en 
bloc by a oYag operation. The three following rows labeled CASEs 1(1), 2(1) and 4 show the slates after grouping oper- 
ations executed for respective cases (descrfced above) urider the specificate Likewise, the row SPE 
2 indicates that CA.5, CA£ and CA. 1 are specked one by one in this order. The three following rows CASEs 1 (2), 2(2) 

45 and 3 shew the states after grouping operations executed for respective cases under the specification condition SPE.2. 
[0060] It is noted that though each grouped scene is shown as proportional in length to the number of constituent 
scenes in FIG. 13, the scene index of the first constituent scene is actually displayed for each grouped scene in the 
scene c£sptay area 43. 

[0061] It should be noted that the above-described grouping function is recursive That is, the grouping exxrtmand can 
so be applied to a scene group all or part of which are grouped scenes. In grouping scenes inducting grouped scene(s), 
grouped scene(s) is (or are) dealt with as independent scenes. For this reason, only the above-mentioned fast and sec- 
ond cases are possible in a recursive grouping. 

[0062] FIG. 14 is a olagram illustrating an example of grouping of grouped scenes in accordance with the principles 
of the invention. In FIG 14, encircled numerals denote specified scenes to be grouped. In step 1, scenes A and C are 
55 grouped into a scene A* C. In step 2, scenes Band F are grouped into a scene B * F. And, in step 3, the grouped scenes 
A*CandB-Fareagain grouped into a scene (A *C) *(B»F). ft is also noted that grouped scenes (A- C) *(B*F)and 
A • C • B • F are identical to each other and accoraSngry provide identical videos. However, it is preferable to store the 
component scenes in the axnponents field 526 of the scene table 520 in a format Oke the former expression ri order to 
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facilitate a so-called undo operation. 
Scene Cfipping based on selection by default 

5 [0063] As shown in FIG. 7, the select fields of the scene table 520 are initially filled with Y*s (for Yes's). This means 
that all of the scenes are initially in the state of being selected for use in a edited video program. Accordingly, in the 
video etfiting system 100, the user selects desired scenes by making unnecessary scene in an unselected state. FIGs. 

15 and 16 are flowcharts showing exemplary operations of an unselection subroutine 300 and a selection subroutine 
310 according to the principles of the invention. 

io [0064] If the user specffies unnecessary scene(s) which is (are) in selected state by means of the above mentioned 
scene specifying function and cficks on a UNSELECT button (icon) 50 on the display screen 40, then the unselection 
subroutine 300 is invoked. In step 302. a value "N," which means an unselected state, is written in each of the select 
fiefo(s) of the scene table 520 associated with the specified scene(s). Then, after updating the SELECTED ORDER 
fields 528 of the scene table 520 (as detaOed later) in step 304, the CPU reduces in contrast or shades the scene 

is index(es) of the unselected scene(s) dteptayed in the scene display area 43 so that the user can easfly discriminate 
between selected scenes and unselected scenes, in step 306. 

[0065] Similarly, the user can select one or more unselected scene again by specifying them with the scene specifying 
function and cficking on a SELECT button 51 on the display screen 40. In this case, the selection subroutine 31 0 of FIG. 

16 is invoked In step 312, a value "Y," which means an selected state, is written in each of the select fteld(s) of the 
20 scene table 520 associated with the specified scene(s). Then, after updating the SELECTED ORDER fields 528 of the 

scene table 520 (as detailed later) in step 314, the CPU displays the scene index(es) of the selected scerte(s) in the 
scene display area 43 in the normal contrast in step 316. 

[0066] tn this way, the video etfiting system 100 permits the user to easily change between selected and unselected 
states of each scene. 

25 [0067] It is noted that this specific embocfiment is using two buttons SELECT and UNSELECT for scene selection, 
however the scene selection may be realized with a single button. In this case, instead of writing a predeterrrHned value 
Y or N in each select field, the value of each select field is read out inverted, and then restored to the select field. 

dp Sorting 

30 

[0068] Once ail scenes that the user thinks to be necessary are selected, the order of the selected scenes or clips 
wiQ be arranged. For this purpose, the editing system 100 is provided with a sort function. The sort function acts only 
on the selected scenes. That is, after the sort command is executed, the selected sorted scenes are disposed from the 
beginning of the scene display area 43, and the unselected scenes are disposed after the sorted scenes. 

35 [0069] FIG. 17 is a flowchart showing an exemplary operation of a sort subroutine 260 according to the principles of 
the invention. If the user issues a sort command specifying one of two sorting schemes, i.a, a sort in selected order 
and a sort in order of time, then the sort subroutine 260 is invoked. If the sort in selected order (selected sequence) is 
specified, the CPU sorts the dps in the selected order whfle keeping the order of dps selected by a drag as they are 
[00701 For this purpose, the SELECTED ORDER fields 528 of the scene table 520 are filled with 1 " at the time of 

40 creation of the record and thereafter updated each time a selection or unselection command is executed as mentioned 
above in connection with FIG& 15 and 16. Specifically, in an unselection operation (step 304 of FIG. 15), for each of the 
specified scenes, the CPU decrements the value of the selected order fields 528 whose values are larger than that of 
the specified scene and writes a value "0" in the selected order fields 528 of the specified scenes. Also, in a selection 
operation (step 31 4 of FIG. 1 6), the CPU searches the selected order fields 528 for the maximum value; and writes the 

45 maximum value plus one in the selected order fields 528 of the specified scenes. This enables dp sorting in the 
selected order. 

[0071] Again in FIG 17, rf the sort in time sequence is specified, the CPU sorts only the order-sensitive dps (i.e., 
selected order-sensitive scenes and selected grouped scenes each inducing at least one order-sensitive scene) in 
order of time while keeping the order of the rest of the c^ps in step 266. 
so [0072] Following step 264 or 268, the CPU displays the sorted dips and the unselected scenes in the scene cfisplay 
area 43 and registers them in a history file 550 in the SceneData directory, tn order to facilitate the undo function, each 
time the user executes a command, the record of the command, command parameters and a fist of the scene (or scene 
index) IDs arranged in order of displayed scene indexes in the scene alsptay area 43 is added to the record list in the 
history f3e 550. 

55 

Relative Position Restoration of a Specified Scene 

[0073] The user is also permitted to move a scene index from one window to another window in a weB-known manner 
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by a drag and drop operation, In the course of editing process using selections, unselections and moves, the user may 
sometimes desire to restore a specific scene to its original position. This is not achieved by the conventional undo func- 
tion which restores the previous state step by step. 

[0074] According to the principles of the invention, the user can restore a specie scene to its relative position with 

s respect to the next scene or the back scene at the time the last se gm en tati on or grouping command has been executed. 
For this purpose, the ORG ORDER fields 522 of the scene tabie 520 are updated each time a segmentation or a group- 
ing is executed so as to retain the oider of the displayed scene indexes as shown in step 229 of FIG. 10B and step 247 
of FIG. 12. Also, as practiced in conventional video etfting system, the state of the scene indexes in the scene display 
area 43 is stored in a history fie 550 in the SceneData directory of FIG. 5 each time any editing command (eg., a seg- 

ro mentation, a grouping, a select, an unsetect, a move and this restoration, too) has been executed. However, this oper- 
ation is not shown in the flowcharts of the accompanying drawings for the purpose of simplicity. 
[0075] FIG. 18 shows an exemplary operation of a relative position restoration subroutine 250 according to the prin- 
ciples of the invention. If the user clicks on a RESTORE button 52 with a desired scene index specified, then the CPU 
enters the subroutine 250. In step 252, open a dialog box, in which the user prompted to select whether the specified 

is scene should be restored to the next-based relative position or the back-based relative position. If the user selects the 
next-based relative position, the speeded scene is moved to just before the scene with the order number 522 just fol- 
lowing the order number of the specified scene If the user selects the back-based relative position, the speeffied scene 
is moved to just after the scene with the order number 522 just preceolng the order number of the specified scene And, 
the control is returned to the main routine of the video-ecfting program 20. Though not shown in FIG. 18, the resultant 

20 state of the scenes is also stored in the history file 550 for future undo operation 

[0076] For better understanding the restoration function, we wffl take an example FIG 19 illustrates how the relative 
position restoration function works in accordance with the invention. In the top row labeled "ORIGINAL ORDER" of FIG. 
1 9, there are cfisplayed scene indexes for five collected material videos M1 through M5 and four narration videos pre- 
pared after the material collection, N1 through N4. Unselecting M4 results in STATE 1, where the scene index M4isc§s- 

25 played in a reduced contrast Moving M5 to after N1 results in STATE 2, where M5 is inserted after N1. Moving M1 to 
after N2, M3 to after N3, and M2 to after N4 results in STATE 3. And, selecting M4 again results in STATE 4. If the user 
issues a relative position res t or atio n command while specifying M4, then the scene index M4 is automatically inserted 
after M3 because M4 was placed after M3 in the original order. 

[0077] Thus, only a desired scene can be advantageously restored to its original position without neither changing 
30 the order of the other scenes nor going back step by step. 

Clamping a Scene to its Original Play Time 

[0078] The user obtains a desired set of ordered clips, i.e , a so-called cfip fist through an editing process using above- 
as described various functions. An edited vkteo program is assembled from trtes 

basis of the clip list, which is derived from the last registered record in the history ffle 550. Generally speaking, the 
assembling is such that video s egm ent s correspond ng to the dips contained in the dp list are concatenated in the 
listed order so as to adjoin the first (or begin) frame of a preceding scene and the last (or end) frame of the scene fol- 
lowing the preceding frame 

40 [0079] FIG 20 illustrates this process. In FIG. 20, one of the source videos A, B and C, i.e. a MAIN VIDEO A is seg- 
mented into five scenes A.1, A.2. A.3. A.4 and A.5. Then, a series of grouping and selections resulted in three CUPS 
A.1* B, A.3 • C and A.5, which are assembled into an EDITED VIDEO PROGRAM 1. 

[0080] However, the user may desire that even in the edited video program (PROGRAM 2) a speeffic scene, say, A.3 
should be played in the same timing as in the original SOURCE VIDEO A. For this purpose, a kind of CLAMPING OF 

46 A.3 (to the source video A) is performed in the concatenation of scenes A.1 • Band A.3* C. In this specific example, 
the scene B has a latter part thereof discarded, resulting in a shorted scene B* in the EDITED VIDEO PROGRAM 2. 
[0001] Thus, acconSng to the principles of the invention, the user is permitted to issue a clamp command specifying 
one of the scenes into which a source video has been segmented (i.e. a divisional scene) or a grouped scene that 
begins with such a divisional scene FIG. 21 is a flowchart showing an exemplary operation of a clamp setting subrou- 

so tine 270 according to the principles of the invention, tn step 271, the CPU writes a predetermined value in the clamp 
field 530 of the scene table 520 associated with the speegted scene If the specified scene is a grouped scene then the 
CPU fate the begin and end frame fields with ap prop riat e values in step 273. Specifically, the CPU copies the value of 
the begin frame field of the first constituent scene of the specified scene to the begin frame field of the specified scene, 
and writes the copied value pfeis the length-in-frame field value minus one in the end frame field of the specified scene 

55 After step 273 or after step 271 if the specified scene is not a grouped scene, the CPU returns to the main routine. 
[0082] As described above, setting a value in a clamp field 530 of a Divisional scene or a grouped scene beginning 
wim a cfivisfortaJ scerie causes the cfivt^ That is, 

the cfivisiona! scene is played in the same timing both in the source video and in a edited video program. 
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Scene Transition Processing 

[0063] The user is permitted to set a special effect on any scene to add an image effect to the transition between the 
scene and the next scene. FIG. 22 shows an exemplary operation of a transitional effect setting subroutine 275. ft the 
5 user issues a transitional effect setting command whfle specifying a desired scene or dipt then the subroutine 275 is 
invoked. In step 277, the CPU cfispiays available image effects tor scene transitions, eg., cfissotve, fade, and wipe so 
that the user can specify a desired one of the displayed effects. In step 279, the CPU writes an effect ID of the specified 
image effect in a transitional effect field 532 of the scene table 520 associated with the specified scene or dip, and 
returns to the main routine 

10 

Video Program Generation 

[0084] After completing a dip list by using the above-deserted features of the video editing system 100, the user 
finally issues a creation or compile command (in user operation step 38) to create an edited video program 3 accorcfing 

is to the obtained dp fist (in system step 26) as shown in FIG. 3. The dp list is preferably stored in a fie ProgramX in the 
directory SceneData or in a different (firectory CUPS (not shown). It is noted that the user may create some dips from 
the same source videos. In such a case, the dip ffles are preferably stored in the efferent directory. 
[0085] FIG. 23 shows an exemplary operation of a video program compiler subroutine 280 called in response to an 
issuance of the creation or compile command, hi FJGL 23, the CPU dps a first video segment identified by the first dp 

20 (record) of the tip list in step 281. In step 282, a test is made to see ft the video segmert needs a 
If so, the specified video effect is applied the segment in step 283. 
[0086] Otherwise, or after step 283. the CPU tfps the 

list in step 285. In step 286, a test is made to see if the current segment is to be clamped. If so, then in step 287 the 
CPU trims the previous video segment so that the end frame number of the previous segment in the program being 

25 compiled is smaller by one than the value of the begin frame field of the dp record of the current segment Otherwise, 
or after step 287, the CPU concat e n a tes the current segment to the previous segment in step 289. Then, in step 290, 
a test is made to see if the current segment needs a transitional process. If sex the CPU applies the specified video 
effect to the segment in step 291. Otherwise, or after step 291, the CPU makes a test in step 292 to see if the dps in 
the dp list have been exhausted- rf so, then the CPU returns to the main routine. Otherwise, the CPU returns to step 

30 285 for the next dp. Thus, an edited video program is generated. 

Embodiment II 

[0087] The second illustrative embodiment of the invention is basically the same as the above-described first embod- 
35 iment except that the display screen 40a of the second embodiment has not only the scene display area 43 inducting 
trie scroO buttons 44 art 45 but also a <fy 28. Since 

the scene indexes (of the unselected scenes) and the dip indexes (of the selected scenes) are cfisplayed in separate 
areas 43 and 53 in the second embodiment,, this tari&tates both the selection of scenes and the arrangement of the 
order of the dps. 

40 [0088] The following description will be focused on the cfifferences between the two errto 

[0089] In FIG. 3, the selected scene indexes or cfip indexes are displayed not in the scene display area 43 but in the 
dip display area 53. 

[00901 The data-related cfirectory configuration of FIG. 5 may be as it is. Since scenes and dips are discriminated by 
the select field of the scene record for the scene orcein question, the scene and dip indexes may be stored in the 
45 same cfirectory Scenelndexes. For the same reason, the scene table 520 contains the records for both the scenes and 
the dps. For the purpose of simplicity, the term "scene recorcT wiH be used for a record of either kind regardless of 
whether the record is for scene or dip. 

[0091] In the first enixxfiment, each record of the history file 550 is exxrprised of a command, command parameters 
and a list of the scene (or scene index) IDs arranged in order of displayed scene indexes in the scene cfisptay area 43; 
so and the list of scene IDs includes both the scene IDs and the dip IDs. On the other hand, each record of the history file 
acxxxcfirig to the second ernbocfiment is comprised of a command, exxnmand parameters, a list of the scene (or scene 
index) IDs arranged in order of cfisplayed scene indexes in the scene display area 43, and a fet of the dp (or dp index) 
IDs arranged n order of displayed dip indexes in the dp cfeplay area 53. 

[0092] A video editing system accorcfing to the second atustrative embod im ent provides almost the same functions 
55 as the abeve-descrfred system 100. Since two video cfisplay areas are avadabJe, the capabflity of the system will be 
listed with the availability thereof in the scene and cfip areas. 

[0093] In the following table; 0 denotes availability of a corresponcfing function and x denotes unavailability of a cor- 
responding function. 
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Functions 


Scene 


Cfp 


a) browsing with next and back icons and/or a scroll bar 


0 


0 


b) recursive scene/dip segmentation available with the browsing function 


0 


0 


c) scene/clip specification with a reversing option 


0 


0 


d) recursive scene/cfip grouping 


0 


0 


e) scene cfipping based on unselection by default 


select 


0 


X 




unselect 


X 


0 


f) dp sorting 


X 


0 


g) relative position restoration of a specified scene 


X 


X 


h) clamping a scene to its original play time (setting) 


X 


0 


i) scene transition processing (setting) 


X 


0 



[0094] As seen in the above table, a) browsing, b) scene/dip segmentation , c) scene/dip specification with a reversing 
option (, which will be detailed later) and d) recursive scene/dip se gm entatio n are available both in the scene and dp 
cfispiay areas 43 and 53 and achieved in the same manner as in the first errxxxfiment 

[0095] However, if a grouping is performed in the scene cfispiay area 43, the resultant grouped scene is taken to be 
selected and accordingly displayed in the dip cfispiay area S3. That is, the select field of the scene record for the 
grouped scene is set for "Y". 

[0096] The relative position restoration (g) is not available in this emborfment The clip sorting (t), the damp setting 
(h) and the setting of scene transition processing (i) are avaflable only in the dip display area 53, and achieved in the 
same manner as in the first embodiment 

Scene/Clip Specification with a Reversing Option 

[9097] According to the principles of the invention, once the user specifies one or more scenes or dips in the scene 
43 or dip 53 display area, the user can reverse the spedfted/unspecfted state of the scenes or dips. FIG. 24 is a dia- 
gram illustrating how the specffiedAinspecffied states of the scenes or cfips are reversed. It is assumed that the user 
has speeded scenes (or dips) A, B and M as shown by label "S/U state 1 Mf the user reverses the state by predeter- 
mined simple operation, the state changes from S/U state 1 to S/U state 2 in which scenes C, D, J, K, L are specified. 
The user can again reverse the state, resultng m 
the edrbng effidency. 

Scene Clipping based on Unselection by Default 

[0098] AS the scenes are first cfisplayed in the scene display area 43 with no frame cfisplayed in the cfip display area 
53 as long a dipping or a grouping, which involves dipping, is not performed. That is, the dipping operation of the 
embodiment is based on a unselection by default schema 

[0099] RQSw 25 and 26 are flowcharts showing exerrplary operations of a selection subrori^ 
subroutine 330 according to the principles of the invention. 

[0100] The selection operation 320 of F)GL 25 is identical to that of FIG 16 except step 326. In step 326. the CPU 
moves the selected scenes from the scene cfispiay area 43 to the dip display area 53. 

[0101] Since an unselection is performed on the dips in the dp display area 53, steps 332 and 334 of FIG. 26 are 

identical to the corresponding steps of FIG. 15 if scene's are changed to dip's in steps 302 and 304. Further, in step 

330, the CPU moves the selected dips from the dip cfispiay area 53 to the scene cfispiay area 43. 

[Q102] FIG. 27 is a diagram showing an example of a scene selection in which a selection command is executed after 

reversing the sperifiecVunspecffied state of the scenes. In RG 27, SC1 indicates that scenes A and G are selected. If 

the user issues an selection command in state SC1 , it causes the state CL1 in which dip indexes A and G arecfisplayed 

in thec^p index cfispiay area 53. If the user issues an selection command after reversing the state CL1 . then it causes 

the state CL2 in which dp indexes B, C, D, E and F are displayed in the cfip display area 53. 

[0103] hi this way, exxnbination of the ftexMe scene/dip specification function and other functions enables an evident 
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video ecfiting. 
Motffications 

5 [0104] Though a scene browsing has been performed on a angle scene in the ato 

skilled in the art that it is possfcle to browse a pkiraity of specified scenes regard! ess of whether the scenes are con- 
tinuous or separated. 

[0105] Many widely different ernbocfiments of the present mention may be constructed without departing from the 
spirit and scope of the present invention. It should be understood that the present invention is not limited to the specific 

10 embodiments described in the specification, except as denned in the appended claims. 

[0106] A video edtti ng system has the functions of: a) scene browsi ng with next and back icons and/or a scrol I bar ; b) 
recursive scene segment a tion available with the browsing function; c) scene/clip specification with a reversing option 
(in case of a system with two cfsplay areas ); d) recursive scene grouping; d) scene doping based on selection by 
default; e) dip sorting in order of time or in a specified order; f) relative position restoration of a specified scene (in case 

is of a system with a single display area); g) damping a scene to its original play time; and h) scene transition processing. 

Claims 

1. A method for generating an ecfited video program from at least one source video in a computer-based video ecfiting 
20 system, comprising the steps of: 

creating a record, for each of said at least one source videos containing information on each said at least one 
video inducting a number of frames constituting the video, said records for said at least one video constituting 
a record set; 

25 searching a user-specrfied one of said at least one video for begin and end frames of each of video segments 

constituting said user-specified video to add, to said record set a record of each said scene which includes a 
begin frame number and an end frame number of each said scene, hereinafter, videos and video segments 
defined by said records being referred to as "said scenes"; 

displaying a frame representative of each said scenes (hereinafter, referred to as Index") in a display area 
30 comprising an array of small windows; 

r^ermrtting a user to segment a desired one of said scenes; 

permitting said user to group desired ones of said scenes into a grouped scene; 

in response to said segmenting and said grouping, updating Redetermined fields of records which contain an 
order of said scenes so that said fields of record reflect an order of current scene indexes; 
35 permitting said user to select desired ones out of said scene indexes tor cfip (indexes); 

permitting said user to order said cfip indexes to yield a dip list; 

in response to a first command said user issues while specifying one of displayed scene indexes, restoring said 
specified scene index to a relative position with resped to a scene index which said specified scene index was 
adjoining at a time of occurrence of a predetermined event; 
40 in response to a redetermined command from said user, exxnpfling said edited video program on the basis of 

said dip list 

2. A method as defined in claim 1, wherein said predetermined event is a later one of a last segmenting and a last 
grouping. 

46 

3. A method as defined in claim 1 , wherein said step of restoring said specif ted scene index comprises the steps ot 

prompting said user to select whether said speeffied scene ndex should be restored to a next-based relative 
position or a back-based relative position; 

so in response to a selection of said next-based relative position, moving said specified scene index to just before 

a scene Mex with which a value of said predetermined field of a record associated is larger by one than a 
value of sad pr e determ in ed field of a record associated with said specified scene index; and 
in response to a selection of said back-based relative position, moving said speeded scene index to just after 
a scene index with which a value of said predetermined field of a record associated is smaller by one than said 

56 value of said predetermmed field of said record associated with said specified scene index. 

4. A method as denned in daiml, wherein said step of pemirttirig said user to seleddesffed ones out of 
as cfip indexes comprises the steps of: 
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in response to an unselection command said user issues while specifying desired dip index(es) in a state of all 
being dips due to selection by defeirtt, changing said specked cfip mdex(es) to scene index(es); and 
in response to a selection command said user issues while specifying desired one(s) of said scene indexes, 
changing said speeded scene index(es) to cfip indexfes). 

5. A method as defined n claim 4, wherein said step of changing said specified cfp index(es) to scene indexes) 
includes the step of changing a normal way of displaying said cfip index(es) to other way and wherein said step of 
changing said specified scene index(es) to cfip indexes) includes the step of restoring said other way to said nor- 
mal way. 

6. A method as defined in claim 4, wherein said step of permitting said user to select desired ones indudes the step 
of permitting said user to specifying said changed specified dip index(es) as said specified scene indexes) to be 
selected. 

7. A method as defined in claim 4, wherein said step of permitting said user to select desired ones includes the step 
of permitting said user to specifying said changed specffied scene index(es) as said specified clip indexes) to be 
unselectecL 

8. A method as defined in claim 4. wherein said step of changing said specified cfip index(es) to scene indexes) 
indudes the step of updating predetermined fields of said reconte so that said predetermined fields retain values 
indicative of an order of selection of respective scenes and clips, wherein said step of changing said specified 
scene index(es) to cfip indexes) includes the step of updating said predetermined fields of said records so that said 
predetermined fields retain values indicative of an order of selection of respective scenes and dips, and wherein 
the method further comprises the step of: 

in response to a command to order said cfip indexes in a selected order, sorting said cfips in said selected 
order. 

9. A method as defined in claim 8, wherein said step of sorting said dips in said selected order indudes the step of, 
if there are dps selected by a drag operation, keeping a current order of said dips selected by a drag operation as 
it is. 

10. A method as defined in daim 3, further comprising the step of in response to a command to order said dip indexes 
in order of time, sorting said cfips in order of time. 

11. A method as defined in claim 10, wherein said step of sorting said dps in order of time indudes the step of, if there 
are dips selected by a drag operation, keeping a current order of said c^s selected by a drag operation as it is. 

12. A method as defined in claim 1 , further compris in g the step of permitting said user to specifying a desired one of 
said scene indexes arid assigning said speeded sc 

said step of compiling said edited video program includes the step of applying said assigned transitional effect to 
said specified scene index. 

13. A method as defined in claim 12, further comprising the step of selecting a dissolve, a fade and a wpe for said pre- 
determined transitional effects. 

14. A method for generating an edited video program from at least one source video in a computer-based video editing 
system, comprising the steps of: 

creating a record, for each of said at least one source video, containing information on each said at least one 
video indufing a number of frames constituting the video, said records for said at least one video constituting 
a record set; 

searching a user-specked one of said at least one video for begin and end frames of each of video segjnents 
constituting said user-specified video to add, to said record set, a record of each said scene which incfodes a 
begin frame number and an end frame number of each said scene (hereinafter, videos and video segments 
denned by said records being referred to as "said scenes"); 

displaying, for each said scenes, a frame representative of said scene (hereinafter, referred to as "a scene 
index") in a display area comprising an array of small windows; 
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in response to a command to view a scene indicated by a scene index specified by a user (a user-specified 
scene), cfispteying a view window at a pr e determ in ed relative position with respective to said user-specified 
scene index, and displaying, in said view window, a frame of said user-specified scene while changing a posi- 
tion of said frame according to a control by said user; 
selecting desired ones out of said indexes as clips; 
ordering said selected indexes to yield a dip list; and 
compiling said edited video program on the basis of said clip Bst 

15. A method as defined in claim 14. wherein said step of displaying a frame comprises the steps ot 

displaying a frame of said user-specified scene identified by a preset initial frame number in said view window; 
in response to an input caused by an operation, by said user, of a switch icon attached to an icon defining a 
movable range of said switch icon, displaying, in said view window, a frame of a frame number calculated from 
said movable range, a relative position of said switch icon and a number of frames of said user-specified scene; 
in response to a first input caused by an operation displaying a frame just prececfing 

said displayed frame in said view window; 

in response to a second input caused by an operation, by said user, of a second icon, displaying a frame just 
following said displayed frame in said view window. 

16. A method as defined in claim 1 4, further comprising the step of, in response to a reception of a predetermined input 
entered during said Displaying a frame, segmenting said user-specified scene making said cfisplayed frame one of 
two boundaries. 

17. A method as defined in claim 16. wherein said step of segmenting a frame comprises the steps of: 

prompt said user to select whether said frame should be made an end frame of a former segment or a begin 
frame of a latter segment; 

in response to said selection, adding a suitable frame number to a queue; 

rf said user desires further segmentation, resuming said displaying a frame; and 

if said user desires no more segmentation, performing segmentations of said user-specified scene according 
to con t ent s of said queue. 

18. A method as defined in claim 17, wherein said step of performing segmentations of said user-specified scene 
includes the step of automatically naming segments resulted from said segmentations by appending a delimiter 
and a sequential notation to an ID of said user-specified scene and wherein the method further comprises the step 
of permitting said user to specify one of said segments resulted from said segmentations as said user-specified 
scene. 

19. A method as defined in claim 15. wherein said Displaying a frame includes displaying a plurality of frames inducfing 
said displayed frame. 

2a A rrathod as defined in clam 15, further com 

scene, setting said preset initial frame number in a pointer field of said record, and wherein said displaying a frame 
of said user-specified scene includes the step of obtaining said preset initial frame number from said pointer field 
of said record of said user-specified scene. 

21 . A method as defined in daim 20, further comprising the step of, in response to a change of the frame number of 
said cfisplayed frame, storing a frame number resulted from sad change in a field associated with said user-spec- 
ified scene 

22. A method for grouping a plurality of video scenes into a grouped scene in a computer-based video editing system, 
comprising the steps oh 

permitting a user to specify desired ones of said video scenes; 

in response to said specifying desired ones of said video scenes and a reception of a predetermined com- 
mand, adding a recocd for said grouped scene to a record set video scenes and 
inchxfing IDs of said specified video scenes rn afield of said added record which IDs of scenes 
constituting a scene associated with said added record; 
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adding an index indicative of said grouped scene to an index set comprising displayed indexes of available 
scenes; and 

deleting indexes of sod user-specified scenes from said index set 

5 23. A method as defined in claim 22, wherein said step of adding an index comprises the step of selecting, for said 
index indicative of said grouped scene, an index of a scene with which said grouped scene begins. 

24. A method as defined in claim 22, wherein said step of inducting said IDs in said field of said added record includes 
the step of keeping the order of said IDs the same as that of indexes of said user specified scenes. 

10 

25. A method as defined in claim 22, wherein said step of inducting said IDs in said field of said added record indudes 
the step of, further in response to an indication that an order of constituent scene of said grouped scene should be 
in order of selection of said user-specified scenes, arranging an order of said IDs in order of selection of said user- 
specified scenes. 

15 

26. A method as defined in claim 25, wherein said step of arranging an order of said IDs in order of selection of said 
user-specified scenes includes the step of , in the event said user-specified scenes includes scenes specified by a 
drag operation of a mouse, keeping an order of said scenes specified by said drag operation as it is. 

20 27. A method as defined in claim 22, wherein said step of inducting said IDs in said field of said added record includes 
the step of, further in response to an indication that an order of constituent scene of said grouped scene should be 
in order of time sequence of said user-specified scenes, arrange an order of said IDs in order of time seopence of 
said user-specified scenes if said user specified scenes have been derived from a single video. 

25 28. A method as defined in claim 22, wherein said step of inducting said IDs in said field of said added record indudes 
the step of, further in response to an indication that an order of constituent scene of said grouped scene should be 
in order of time sequence of said user-specified scenes and in response to a determination that said user specified 
scenes indude other scenes than scenes derived from a single scene, for arranging only said scenes derived from 
a single scene in order of time sequence while keeping an order of said other scenes as it is. 

30 

29. A method as defined in claim 22. further cornprising the step of permitting said user to indude at least one of said 
grouped scenes in said user-specified scenes. 

30. In a computer-based system tor generating an edited video program from video scenes induding video segments 
35 derived from a single source video, a method for causing a start time, in said edited video, of a user-specified one 

of said video segments to be the same as that in said single source video (hereinafter referred to as "clamping said 
user-specified video segment to said single source video"), cornprising the steps of: 

in response to a command to darrp said user-sped setting a flag in a predetermined field of a record 

40 associated with said user-specffied video; and 

compiling said ecfited video program on the basts of records for dipped scenes, said step of compiling said 
edited video program inducing the step of: 

trimming a scene just prececting said user-specified video so that an end frame number of said preceoSng 
45 scene in a prop/am being compiled is smaller by one than a value of a begin frame field of said record 

associated with said user-specified video. 

31. A method for generating an etfted video program from at least one source video in a computer-based video ectiting 
system, comprising the steps of: 

50 

creating a record, for each of said at least one source video, containing information on each said at least one 
video indufing a number of frames conslilutif xj the video, said records for said at least one video constituting 
a record set; 

searching a user-specked one of said at least one video for begin and end frames of each of video segments 
ss constituting said user-specified video to add, to said record set, a record of each said scene which includes a 

begin frame number and an end frame number of each said scene, hereinafter, videos and video servients 
defined by said records being referred to as "said scenes"; 

displaying a frame representative of each said scenes (hereinafter, referred to as "scene index") in a first rJs- 
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play area comprising an array of smai windows; 

displaying a frame representative of each of selected ones (L&. cfips) of said scenes (hereinafter, referred to 
as "clip index") in a second display area comprising an array of small windows; 
permrtting a user to segment a desired one of sad scenes or cfips; 

permitting said user to specify desired ones of said indexes to make said desired ones in a spectfied state and 
remaining indexes in a nonspedfied state, said step of permitting said user to specify desired ones including 
the step of: 

further permrtting said user to reverse said specified state and said nonspedfied state; 
in response to said step of permitting said user to specify desired ones and a grouping command, group- 
ing indexes in said specified state into a grouped dip indexes; 

in response to said step of perrnitting said user to specify desired ones and a dipping command, changing 
scene indexes in said specffied state to clip indexes; 
permitting said user to order said dip indexes to yield a dip fist; 

in response to a predetermined command from said user, compiling said edited video program on the 
basis of said dip list 

32. A system for generating an edited video program from at least one source video, comprising: 

means for displaying information used in an editing process, said means having a first area comprising an array 
of windows for each displaying a frame representative of each of available scenes constituting said at least one 
source video (said frame being hereinafter referred to as "a scene index") and a second area compris in g a 
smaller array of windows for each c5splaying a frame representative of each of selected ones (La, dips) of said 
scenes (hereinafter, referred to as "a clip index"); 

means for containing records associated with said scenes, a record of each said scene at least having fields 
of an ID and a number of frames for the scene; 

specifying means for permrtting a user to specify desired ones of said indexes to make said desired ones in a 
specified state and remaining indexes in a nonspedfied state, said specifying means induding: 

means responsive to a predetermined input from said user, for reversing said specified state and said norv 
specified state; 

means responsive to said specifying means and a grouping command for grouping indexes in said sped- 
fied state into a grouped dip indexes; 

means responsive to said specifying means and a dipping command for changing scene indexes in said 
specified state to dp indexes; 

means for permitting said user to order said cfip indexes to yield a cfy list; 

means, responsive to a predetermined command from said user, for compiling said edited video program 
on the basis of said dip fist. 

33. A system as defined in claim 32, further comprising means, responsive to a command to view a scene inc5cated by 
a scene index specified by a user (a user-specified scene), for olsplaying a view window at a predetermined relative 
position with respective to said user-specrfted scene index, and displaying, in said view window, a frame of said 
user-specified scene while changing a position of said frame accorcSng to a control by said user. 

34. A system as defined in daim 33, wheremsaidmeareforcSsplayingafrarro 
ity of frames induding said displayed frame. 

35. A system as defined in claim 33, wherein said means for olspiaying a frame comprises: 

means for displaying a frame of said user-specified scene identified by a preset initial frame number in said 
view window; 

means, responsive to an input caused by an operation, by said user, of a switch icon attached to an icon defin- 
ing a movable range of said switch icon, for cfispiaying, in said view window, a frame of a frame number calcu- 
lated from said movable range, a relative position of said switch icon and a number of frames of said user- 
specified scene; 

means responsive to an input caused by an operation, by said user, of a first icon, for dsplayrng a frame just 
prececfing said displayed frame in said view window; and 

means responsive to an input caused by an operation, by sad user, of a second icon, for displaying a frame 
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just following said displayed frame in said view widow. 

38. A system as denned in datm 35. further c wp i isin y means activated at a time Off creating a record for said user- 
sperified scene lor setting said preset initial frame number in a pointer field of said record, and wherein said dis- 
s ptaying a frame of said user-specified scene includes means for obt ai ni n g said preset initial frame number from 
said pointer field of said record of said user-specked scene 

37. A system as defined in claim 36, further compri si ng means responsive to a change of the frame number of said 
displayed frame lor storing a frame rurrfcer resulted from said eta 

io scene for resuming a current view. 

38. A system as defined in claim 33, further comprising means, responsive to a reception of a predetermined input 
entered during said displaying a frame, for segmenting said user-specified scene making said displayed frame one 
of end and begin frames. 

15 

39. A system as defined in claim 38, wherein said means tor segmenting a frame comp ri ses: 

means for prompting said user to select whether said frame srtould be made an e 
or a begin frame of a latter segment; 
20 means responsive to said selection for adding a suitable frame number to a queue; 

means; activated in the event said user desires further segmentation, for resuming said displaying a frame; and 
means, activated in the event said user desires no more segmentation, for performing se gm entations of said 
user-specified scene according to contents of said queue. 

25 40. A system as defined in claim 39, wherein said means for performing segmentations of said user-specified scene 
includes means for automatically naming s eyi ne n ls resulted from said segment a tion s by appending a delimiter and 
a sequential notation to an ID of said user-specified scene and wherein the system further comprises the step of 
permitting said user to specify one of said segments resulted from said segmentations as said user-specified 
scene. 

30 

41. A system as defined in claim 32, wherein said means for grouping specified indexes into a grouped clip indexes 
comprises: 

means responsive to said specifying means and a reception of IDs of user-specified scenes for add ng a record 
35 for said grouped scene to a record set compris in g records of available video scenes and including said IDs in 

a field of said added record which is for containing ID of scenes constituting a scene associated with said 
added record; 

means for adding an index indicative of said grouped scene to an index set comprising displayed indexes of 
available scenes; and 

40 means for deleting indexes of said user-specified scenes from said index set 

42. A system as defined in claim 41 , wherein said means for adding an index comprises means for selecting, for said 
index indicative of said gjouped scene, an index of a scene with which said grouped scene begins. 

45 43. A system as defined in claim 41, wherein said means for including said IDs in said field of said added record 
includes means for keeping the order of said IDs the same as that of indexes of said user specified scenes. 

44. A system as defined in claim 41, wherein said means for including said IDs in said field of said added record 
irK^ixies means, farther responsive 

so be in order of selection of said user-specified scenes* tor arranging an order of said IDs in order of selection of said 
user-specified scenes. 

45. A system as denned in claim 44, wherein said rneans for arranging an order of said IDs in orto 
user-specified scenes includes the step of , in the event said user-specrfied scenes includes scenes speeded by a 

55 drag operation of a mouse, keeping an order of said scenes specified by said drag operation as it is. 

48. A system as defined in claim 41, wherein said means for including said IDs in said held of said added record 
includes means, further responsive to an inefcation that an order of constituent scene of said p/ouped scene should 
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be in order of time sequence of said user-specSed scenes, for arranging an order of said IDs in order of time 
sequence of said user-specified scenes if said user specified scenes have been derived from a single video. 

47. A system as defined in claim 41, wherein said means for including said IDs in sad field of said added record 
5 indudesmeare, further resp scene of said grouped scene should 

be in order of time sequence of said user-specified scenes and responsive to a determination that said user-spec- 
ified scenes include other scenes than scenes derived from a single scene, for arranging onty said scenes derived 
from a single scene in order of time sequence while keeping an order of said other scenes as it is. 

w 48. A system as defined in claim 41, further comprising means for permitting said user to include at least one of said 
grouped scenes in said user-specified scenes. 

49. A system as defined in claim 32, wherein said means for changing specified scene indexes to dp indexes com- 
prises: 

15 

responsive to said specifying means and a selection command from said user, changing said specffied scene 
index(es) to dip indexes); and 

responsive to said specifying means and an unselection command from said user, changp ng said specffied dip 
index(es) to scene index(es). 

20 

50. A system as defined in claim 49, wherein said means for changing said specified scene index(es) to dip index(es) 
includes means for updating said predetermined fields of said records so that said predetermined fields retain val- 
ues indicative of an order of selection of respective scenes and dps, wherein said means tor changing said spec- 
ified cfip index(es) to scene indexes) indudes means for updating predetermined fields of said records so that said 

25 predetermined fields retain values indicative of an order of selection of respective scenes and dips, and wherein 
the system further comprises: 

means responsive to a command to order said dp indexes in a selected order for sorting said dps in said 
selected order. 

30 

51 . A system as defined in claim 50, wherein said means for sorting said cfips in said selected order indudes means, 
responsive to a determination that there are dips selected by a drag operation, for keeping a current order of said 
dips selected by a drag operation as it is. 

35 52. A system as defined in claim 32, further comprising means responsive to a command to order said cfip indexes in 
order of time for sorting said c^ps in order of time. 

53. A system as defined in dam 52, wherein said means for sorting said dps in order of time includes means, respon- 
sive to a determination that there are dips selected by a drag operation, for keeping a current order of said dips 

40 selected by a drag operation as it ia 

54. A system as defined in claim 32, wherein said scenes includes video segments derived from a single source video 
(hereinafter, referred to as "derivative scenes"), and wherein the system further comprises means for causing a 
start time, in said edited videa of a user-specified one of said video segments to be the same as that in said single 

45 source video (hereinafter referred to as "damping said user-specified video segment to said single source video"), 
said means for damping said user-specified video segment to said single source video comprises: 

means responsive to a command to damp said user-specified video for setting a flag in a predetermined field 
of a record associated with said user-specified video; and 
so means for compiling said ecfted video program on the basis of records for dipped scenes, said mearis for com- 

ptiing said edited video program incfcjding the step of: 

trimming a scene just preceding said user-specified video so that an end frame number of said prececfing 
scene in a program being compiled is smaller by one than a value of a begin frame field of said record 
55 associated with said user-specified video. 

55. A system as defwied in daim 32, further comprising means for permitting said user to specifying a desired one of 
said scene indexes and assigning said spedfied scene index one of predeterrnnedtrare 
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said means for compBng sakJ erfted video pro-am includes the step of applying said assigned transitional effect 
to said specified scene index 

56. A system as defined in claim 56, wherein said predetermined transitional effects are a dissolve, a fade and a wye. 

5 

57. A system tor generating an edited video prog ram from at least one source video, comprising: 

means tor displaying Bitormation used in an editing process, said means having a area corrprising an array of 
windows for each displaying a frame representative of each of avaJabJe scenes constituting said at least one 
10 source video (said frame being hereinafter referred to as "a scene index"), said scenes being to be of splayed 

in said area even if they are selected as cfips for use in said video prop/am; 

means for containing records associated with said scenes, a record of each said scene at least having fields 
of an ID and a number of frames for the scene; 

specifying means tor permitting a user to specify desired ones of said indexes; 
75 means responsive to said specifying means and a segmentation command tor segmenting a specified scene 

or clip; 

means responsive to said specifying means and a grouping command tor grouping specified indexes into a 
grouped dip indexes; 

means responsive to said se gm ent in g and said grouping for updating predetermined fields of records which 
20 contain an order of said scenes so that said hefts of record reflect an order of current scene indexes; 

means responsive to said specifying means and a cfipprng command for changing specified scene indexes to 
cip indexes; 

means for permitting said user to order said dip indexes to yield a dp fist; 

means responsive to said specifying means and a first command for restoring said specified scene index to a 
25 relative position with respect to a scene index which said specified scene index was adjoining at a time of 

occurrence of a predetermined event; 

means, responsive to a predetermined command from said user, for compiling said edited video program on 
the basis of said dip list 

30 58. A system as defined in claim 58, wherein said predetermined event is a later one of a last segmenting and a last 
grouping. 

59. A system as defined in claim 58, wherein said means for restoring said specified scene index comprises: 

35 means for prorrpting said user to select whether said specified scene index should be restored to a next-based 

relative position or a back-based relative position; 

means, responsive to a selection of said next-based relative position, for moving said specified scene index to 
just before a scene index with which a value of said predetermined field of a record associated is larger by one 
than a value of said predetermined field of a record associated with said specified scene index; and 
40 means, responsive to a selection of said back-based relative position, tor m 

just after a scene index with which a value of said predetermined field of a record associated is smaller by one 
than said value of said predetermined held of said record associated with said specified scene index. 

60. A system as defined in claim 58, wherein said means for changing specified scene indexes to dip indexes com- 
45 prises: 

means, responsive to said specifying means and an unselection command issued in a state of all being dips 
due to selection by default, tor changing said specified dp index(es) to scene index(es); and 
means, responsive to said specifying means and a selection command from said user, for changing said spec- 
so rfied scene index(es) to cfip index(es). 

61. A system as defined in claim 61 , wherein said means for changing said specified cfip indexes) to scene indexes) 
includes means for changing a normal way of displaying said dp index(es) to other way and wherein said means 
for changing said specified scene index(es) to cfip index(es) includes means tor restoring said other way to said 

55 normal way. 

62. A system as defined in claim 61 , wherein said means for changing specified scene indexes to dp indexes indudes 
means for permitting said user to specifying said changed specified dp index(es) as said specified scene indexes) 
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to be selected. 

63. A system as defined in claim 61, wherein said means for permitting said user to select desired ones includes the 
step of permitting said user to specifying said changed specified scene index(es) as said specified dp index(es) to 
be unselected. 
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